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The task of teachc^r personnel policies should be to 
get good teaching done with justice and econoay. Ihe current state of 
teacher personnel policies is that they are reasonably fair to 
teachers and extr#aely unfair to students, parents, and taxpayers* 
They protect all teachers, but they excessively protect the 
incoapetent teachet* i systea of strict perforaance evaluation aust 
be developed that i^eplaces the systea of teacher evaluation based on 
classrooa observations by an adainistrator* Such a nev systea vould 
not aalte use of observations because they represent a saall, 
unrepresentative sample froa a biased observer. Ihe nev syatea vould 
only use facts about t\e teacher that deiorstrably bear on validated 
iob requireaents: (1)\ soae estiaate of the aaount learned by the 
students: (2) a reliable judgeaent of its quality; ana (3| a 
guarantee of the l^gitiaacy of ,the teaching process. Teacher 
perforaance in the eleaentary gradei vould be aeasured by pre/post 
testingt and in the secondary grades by siailar testing and/or 
student evaluations. Teachers vho are consistently about tvo standard 
deviations off the nora vould be subject to a varning and eventual 
disaissal. This systea insures fair treatment and good teaching. 
f&uthor/APHI 
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TEACHER PERSONNEL POLICIES: EQUITY, VALIDITY AAI> PRODUCTIVITY 

Michael Scriven 

M« a conversation behv-een adm,nis,ra,o,s a. various Ms. abou. ad,n,„is«H« p„bte„s and ,he , 
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ana documented and encourage., and thus incorporated into teacher personnel policies Ye. I f,nd 

ar,d"J^*a"ard "T^ '° '° "P*"— Jacobs 

ducli^^^nH H a •^S' ^> contradicSonVand counterpro- 

m n r »■ '"ould we have and no. have for ™/„.,y„, 

alll'^rnn!^:r""'"'r''""'"''^«^"'^'P''""-''''*-''^''^ave.obe,nad^ 

S «,L^re^^l '° r " '"^ o' 
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ons,sten ; Kenstennacher wants it implemen.«. educatively. I want a» those things b firs, nd 
fo«.m« . wan. ,t a,.„,. I want the policies to incorporate an implici. dcfiniHon o. g Jteach 1 .L." s 

folate Xh" ."iTT' """^"8 .*a. we oTCo 

formulate. All the testis buU. on «ind unless we ge. the first step right 



1. The current state of teacher personnel policies is that they are reasonably fair to teachers— a great 
improvement over the pre-union situation— and extremely unfair to students, parents and taxpayers. 
They protect all, but they cxce$snH:ly protect the congenital incompetent, the once-but-no-longer-com- 
petent and the competent non- performer. Unless we begin by making this clear, we are fooling around 
with the issue. Anyone who knows anything about schools knows that what I've said is true, and anyone 
who knows anything about schools knows that the results are serious, in terms of tumed-off, perma- 
nently demotivated students; lowered morale amongst other teachers— and students and adminis- 
trators—because of their resentment of the toleration of incompetence, lowered performance amongst 
other teachers because they see what one can get away with; lowered immediate performance by the 
students who are saddled with rotten teaching, lowered respect by the community for the schools, which 
shows up in the move to vouchers, to more and more private schools and in the failure of bond issues. 
The worst problem is that all this is going on at a time when ihere is declinmg performance by students, 
and an increasing set of cumcular pressures (e.g computer literacy, multilingual skills) against a 
backdrop of declining public expenditures on human services and increasing concern with U.S. pro- 
ductivity. But we have teacher policies that ruthlessly sacrifice productivity for equit>' Productivity 
without equity is morally intolerable, equity without productivity is socially irresponsible. 

2. We are talking about personnel vohcies —and in particular personnel policies that reflect sound 
evaluations, the crucial part of personnel policies— and we all know that no policv' is perfect. It might 
appear that the imperfections I have just described are simply the price that any policy- has to pay for the 
irregularities in the real world that do not fit any policy simple enough to administer. Let me say that due 
consideration of this argument has led me to its total rejection. Present policies range from unsatisfactory 
to absurd —they are nowhere near the point of optimal realistic formulation or application . (Reasons in 7 
below) 

3. The evaluation-related teacher personnel decisions that should be addressed by an LEA personnel 
policy may be classified under twelve headings. 

00. needs assessmen and resource allocation 

0. job describing/recruiting/advertising/intervie wing 

1. selection/placement/appointment 

2. retention (continuance)/non-retention (termination, separation) 

3. tenured/untenured continuance 

4. promotion/demotion 

5. salary raise/cut 

6. bonuses/fines: money and non-money bonuses (e.g. office or schedule choices, leaves) 
should be included. 

7. official commendation/reprimand 

8. reassignment (site or job) 

9. change of duties 

10. early /late retirement 

There are additional SEA options e.g. licensing/credentialing and license revocation. They are not 
central to our concerns here and I have addressed them in the course of setting out a new credentialing 
system for California (Scriven, 1979). There are also a substantial number of teacher policy issues the 
SEAs and LEAs face which are not merit-related e.g. school population projections. These have been 
well covered by Von Valletta and ' «*v no more about them here. 



4. Considerations or concepts involved in discussions of the appropriate personnel policy for ad- 
dressing the above issues, even if not in the eventual policy, include one group that essentially relate to 
individual cases, viz* 

1. Seniority 

2. Special (or protected) group status (minority, gender, handicap) 

3. Teaching merit 

4. Worth of personnel to system because of considerations other than teaching merit e.g 
political, morale (verbal attacks on colleagues), fund-raising, union role, lunchroom 
useability 

5. Qass size/workload 

6. Special skills inventory or versatility 

7. Going rate from competitive employers or private practice (e.g. petroleum engineers, 
surgeons, business, computer sciences) 

8. Productivity ^ 

9. Performance standards 

and one group that refers to general background factors that relate to any system of policies. 

1. Legal requirements and problems including conflicting mandates, mainstreaming, ex- 
cluded duties, due process, open files 

2. Scientific validity of criteria 

3. Funding available, special or regular 

4. Staff development; level of effort and quality; staff retraining, counseling etc. 

5. Tin»3, money, credibility and skill requirements of evaluation system 

6. The probable costs of an increasingly elderly faculty: 

a. increased average salary 

b. reduced ^adaptability 

c. absence of expertise in newly emerged curriculum areas e.g. computer science /new 
learnings 

d. reduced rapport with pupils 

7. Hazard pay 

8. Early retirement inducements 

9. Arbitration bias 

10. Turf disputes (e.g. NEA/AFT, teacher/teacher aide) 

11. Reduction of public support 

12. Needs assessment 

13. Benefits package 

14. Grievance procedures 

15. Formally adopted written policies 

5. I find the preceding lists to be useful in looking over any pjolicy or set of policies in order to check 
whether it covers the territory it has to cover. Some people find it an intimidating list, defining an 
impossible task; I find it quite manageable, defining only a strenuous task, but one which is, I believe, the 
key to the survival of the public schools in any acceptable form. One of the reasons I see hope where 
Others despair is a recent landmark decision in the Eighth Circuit Court of Appeals which held that a 
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supenntendent was enhHed to dismissa teacher whose (fourth grade) pupils were not learning nearlv as 
much as the pupils of her colleagues. This might be appealed and it might I* reversed at the Supreme 
Court level, but that will probabK only tell us that ^^e need certain further evidential support or a more 
complex prtKess. It seems clear that the pmaple of performance evaluation is legal and that the >m,plc>t 
defensible version of it was upheld is the first good news m some hme on this front. This was a 
productintv critenon, but not a mereK quantitative criterion. The tests were (supposedK ) of quality 
learning. 

6 There is, m f«ct, a silver lining to most of the bad news about serious efforts at act,ng on negative 
teacher evaluations. While it has usually failed to protect us from bad teaching, the reasons are clear 
enough and clearly enough related to justice, so that we should feel both ashamed of the wav we have 
prepared these cases and greatly encouraged about the possibility of doing better Onlv if one fails to 
follow thp logic of the arbitrator or the court should one be discouraged The logic of ,v,stice ,> complex 
and It IS right that it should failsafe for mdividuals not institutions like the police or the scnools The 
blame for the excessive cost of the failures lies squarely on our shoulders for not doing our homework 
Specifically on SEAs and the federal agenc.es and schools of education for not giving the support the 
LEAs need to develop bettei polices. While it is clear that the unions would not be enthusiastic about 
such support or about any superintendent thci requested it, the seriousness of -this issue makes lack of 
efforts htre a cheap political posture, maintained at the expense of students, schools and taxpayers. 

7. The bad news is that we' have not yet come near to plumbing the depths of the legal difficulties. The 
unholy alliance of unions and administrators has kept in place a system that is scientificallv indefensible 
and completely unethical, a combinafi.n of virtues that wUI ensure its demise the moment some teacher 
with the relevant knowledge appeals to the courts without relyingon the union, lam referring to the K-12 
system of teacher evaluation based on classroom observations by an administrator. There is absolutely 
nothing salvageable about this approach and it must be replaced with direct or indirect performance 
evaluation as soon as possible. I have outlined the appropriate proceiare elsewhere (Scriven, 1981, in 
press) and will not repeat the details here, making only the fo"owing summary comments: 

a. Observations are useless because they represent a sample that is too small, unrepresentative, 
made by a biassed observer, ,id of irrelevant t?ehavior. 

b. Even if tiiere were any known reliable connections between what could be observed, i.e. 
teaching style, and learning outcomes, which there is not; and even if the observation was done on 
an adequate sample (for which we cannot afford the time); in an unobtrusive way (which is Ulegal); 
by an unbiassed observer (none of whom are avaUable), we couldn't use it. That is because the 
connection would only be a statistical one, and one cannot base adverse personnel deasions on 
statistical generalizations in this case any more than one can use the known statistical connection 
between skin color and crime rate m making personnel decisions. One can only use facts about the 
individual that demonstrably bear on validated job requirements. 

c. What one can and must have are three items. First, some estigiate of the amount leamt by the 
students, second, a reliable judgment of its quality, and third, a guarantee of the leptmacy of the 
process of teaching (not its jptimality, which is a style judgment -legitimacy is an ethical judg- 
ment). These estimates can be obUmed by direct expert measurement or by consumer estimates 
based on direct observations-nothing else will do, scientifically or legally. (Tliis is the validity 
issue.) 

d. To these one can add a fourth component-it is not essential, but it is desirable -some input 
from the teacher about self-« activities. I call this the professional development dossier 



ERIC 



That's the package, and there's no doubt that sethng it up will cost something, not a great deal, and 
running it will cost somewhat more than running our present system I make no predictions as to 
whether this needed refonn will take place on a large scale. 1 only say that unless we make it, the system is 
doomed not ottly politically but educationally 

I should add the footnote that no system of teacher evaluation can work in a vacuum and in particular it 
should not have to work in the absence of (i) a good qualit\ teacher development system (orienting, 
counseling, supenising) system; (ii) a sound administrator evaluation; and (in) a solid grievance 
procedure, 

8 Appealing to the need to keep up with the Russians produced more action m curriculum reform 
than appealing to considerations of merit, and the merit will probably fare no better m the case of teacher 
personnel polices. What may bring us to our senses is the hscal disaster presaged by the increasing cost 
of an ageing facult>' protected from dismissal by seniority rules, and consummated by the termination of 
age-based retu-ement. To avoid the prospect of dribbling dotards in the classroom, we will have to 
develop, and regularly and uniformly apply, well-defined and tough quality standards toever>' facult\' 
member, from probation to departure. (This will, at exactly the point where it does its job effectively, and 
in combination with the "just cause" doctrine, make tenure a virtually empty concept, but let's not make 
unnecessary trouble by making that the starting point of the argument.) 

9. What about all the SEA/LEA mandated approaches to Teacher-ei^aluation ^ All those obser\'ation checklists 
and requi/ed hours of visits? As Valetta pbinted out with respect to affirmative action, this is where we 
find out what your true values are. If the law requires something, doit untilyou can get the law changed, * 
but let's see you paying your dues to get it changed. If it's not worth a Uttle of your time to make that 
effort, you don't-care much about it. But in most cases if you look at the law, you find it do^s not exclude 
the use of other evidence, in which case you take a good look at the classroom, fill the form out with the 
&ame grade on everything for everyone, ind gei to work on the performance evaluation which is what 
will then carry the weight. People should be evaluated on what they achieve, not on whether one judge 
happens to like the way that they do it. That's a moral as well as a legal point. 

10. Haw do you get performance measures? In the elementary grades, by random (or nearly random) 
allocation of students to teachers and simple pre /post testing, using an appropriate test i.e. one which 
draws fi-om a pool of locally generated (but professionally checked) items combined with a hard core of 
50 per cent nationally constructed and normed items, the pool being 10-20 times the size of the test anc' 
fully public; the drawing being made on the day of the test by the administrator v/hose secretary will 
deliver copies to the classrooms, and stratified to contain a reasonable distribution across sub-areas and 
50 per cent pre-normed items. In the secondary grades, this procedure will sometimes not work because 
only one teacher handles a subject, in which case student evaluations should be used with all the usual 
precautions and pretraining of students. They are a very good substitute, in sc.ne ways superior to direct 
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1 1 . Hou' do you convert learning gains or studcftt-ratings into personnel standards? You look for teachers that 
are consistently about twc standard deviations off the pace. With any luck, that will be nobody. But 
sometimes there are sucJ. teachers and their students cannot be sacrificed year after year. Of course, you 
move through notifying, to warning, to action across three yeari. Of course you arrange for whatever 
help you can, while meticulously avoiding providing it yourself for reasons which should be obvious but 
have apparently escaped most adminicfra*/.--. Of course, you couple down-side risks with up-side gains 
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i.e merit pay whidi avoids the usual abuses (and retains the usual |ustification) if tied to a system like the 
one described here. (This is the productivit>' issue; see also 17 below .) 

12 H.ni'doyou ^et a systm Itkc tfm mihtutuviali:xd lu the face of the sfi.n» ofoppofituvt if may uvll eiitymlcr^ 
You begin with volunteers, and only after you and they are convinced it's a better basis for continued 
professional development as well as personnel decisions do you take it to the school board and start to 
negoiiate it into the agreement, (if you are using your brains, you will realize that in many systems you 
will not have to do this in order to implement It.) 

13. Why should anifcieiioluutecr^ Not only because we still have a cadre of dedicated professionals who 
want to be judged by and indeed learn about their achievements, but because even a cynic knows that 
extra data is an extra edge when lay-off time comes around and seniority considerations leave some room 
for choice, and even a cynic knows that if a new svstem is coming down it pays to get a little experience 
with it. And of course, the volunteers are guaranteed that the results of the trial runs wiU only become 
part of their dossier if they decide to leave them there. 

14. Hem- OTC judgments of quality to be made? Essentially by expert review of the content of the learning, 
the choice of materials, the construction and grading of the tests, the feedback to students on projects etc. 
The experts might be peers, a departmental chair, a principal or assistant principal with relevant 
qualifications who is not in charge of the personnel review, or a curriculum speciaUst, from this or 
another school or district. These reviews are more costly than the present ones and should be biennial or 
triennial not annual (except for probationers), not only to save money but to ea'e pressure and allow 
experimentation. 

15. Hou' is legitimacy of process tobe judged? Some input to this spills over from the quality review; some 
from student evaluations where used; some from parental input; and some from student complaints or 
from discussions with students. In general this part of the system requires only the setting of alarms not 
constant checking. If an alarm rings, discussion with the teacher is the next step; the input here is not 
highly valid, just a starting-point for checking. 

16. Wmt about the Professional DeiKlopment Dossier? This is the key link between summaHve and 
formative evaluation, the device for upgrading self-evalaation to the level of externa! evaluation, the 
procedure for picking up early warnings of good or bad things to come. It is the teacher's own domain, 
the record of their achievements and expertise seen through their own eyes, plus some reactions by the 
supervisor. It is judged by set standards, with room for additional points for innovation and inspiration . 
One administrator should do the judging, but only after a great deal of supervised experience; and it 
must not be the supervisor. 

17. Hau'does this system avoid the usual injustice cf blaming teachers for the performance of students aver whose 
achievement levels they have so little real control? Simply by restricting comparisons so that responsibility is 
ascribed only fortergecons/sfcnf differences in performance on compartfWe students. In general, this means 
students within the same school but there will be cases whsrs ii goes beyond that to other schools in the 
same or possibly an essentially similar Histrict. Teachers are the only cause of these differences and if they 
are large and positive they deserve rewards; if Urge and negative, some assistance; if continued bad, 
some action. Note that there is no competitiveness involved in the vicious sense, since there can be 
winners without losers, and being slightly off the pace is no basis at all for any unfavorable pereonnel 
action, since the accuracy of the system does not give small differences any significance at all (other than 
sUtistical significance, which de iucatior^il or personnel attention in itself. ) . 
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18. If the present sy^^tetn is O'^ bad a< I claim. ir//y lia< it ;vrs/s/t\f s*) lou^'' 1 spoke earlier of an unholy alliance 
jf the administrators and unions This is not a conscious conspirac)', but the results are the same It must 
be realized that administrators have little incentive to increase their load— and ar.y new personnel 
policies will do that And it must be realized that unions have ever\' incentive not to protest the basic 
shape of present policies because the protest v\ ouid involve grievances on a scale they cannot affotd, and 
the new poiiaes will bring in not one cent more dues, which are paid by all warm bodies employed as 
teachers, whether or not they can teach. 

Consequently unions protest, and admmistrators try to avoid, inequit) put not invalidit)- let alone lov\ 
productivit}'. 

19. Would not the proposed systerii open the doors to a neu' "co7i$ffiraciii\ this time of teachers who see that their 
interests are best sen^d by keeping their perfonnance level loie? One can envision high performers being treated 
as traitors to their colleagues because they pull the average up and hence, perhaps, drop someone into 
the cellar of jeopardy This totally unprofessional attitude would of course have to be treated as grounds 
for dismissal if expressed or embodied in action. I do not believe we should treat it in any detail unless it 
becomes a problem, but I will say that I think it can easily be handled by a combination of appropriate 
inter-school comparisons, really substantial rewards for high performance, the use of semi-interquartile 
range instead of standard deviations and so on. 

20. To conclude I have tried to focus this discussion of teacher personnel policies on what I see as the 
ultimate point of them all. I have suggested that our practices and even our thinking is so jaded by the 
bitter taste of bureaucratic bungling that we forget to pay attention to the nutritional question, the 
question whether the system feeds the hungry minds of children as well as it can. I have suggested that 
the task of feeding the multitudes is not too difficult, that policies for doing it that avoid the well-known 
traps can be formulated. Implementing them is no mean task, but failure to implement them is 
irresponsible and will bring almost certain disaster. 
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